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COMPATIBILITY  EVALUATION  AND  RESEARCH  ON  THE  COMPUTER  ADAPTIVE  SCREENING  TEST 
(CAST)  FINAL  REPORT:  USER  AND  PROGRAMMER'S  GUIDE 

EXECUTIVE  SUMMARY . . . 


Requirement; 

To  provide  program  maintenance  and  ensure  software  compatibility  of  the 
Computerized  Adaptive  Screening  Test  (CAST)  with  the  Electronic  Information 
Delivery  System  (EIDS),  and  further  refine  the  CAST  item  selection  software 
and  score  reporting  format. 


Procedure: 

The  CAST  program  software  was  rewritten  to  be  compatible  with  the 
Electronic  Information  Delivery  System  (EIDS)  now  being  used  by  the  U.S.  Army 
Recruiting  Conmand  (USAREC).  In  addition,  further  development  was  done  to 
refine  the  item  selection  software  and  score  reporting  format.  Improvements 
were  made  in  test  item  selection,  reporting  capability,  experimental  item 
selection,  data  storage  capability,  item  bank  access,  and  software 
coordination. 


Findings: 

The  revised  CAST  is  less  prone  to  compromise,  allows  the  researcher  more 
flexibility  In  gathering  CAST  data,  requires  less  access  time,  and  is 
configured  for  greater  compatibility  with  the  EIDS. 


Utilization  of  Findings: 

This  report  will  be  used  by  the  U.S.  Army  Recruiting  Command  as  part  of 
its  ongoing  evaluation  of  CAST  as  an  enlistment  screening  test. 


COMPATIBILITY  EVALUATION  AND  RESEARCH  ON  THE  COMPUTER  ADAPTIVE  SCREENING  TEST 
(CAST)  FINAL  REPORT:  USER  AND  PROGRAMMER'S  GUIDE 


•01:114:1^ 


Page 

GENERAL  OVERVIEW  .  1 

INTRODUCTION  .  3 

What  CAST  Is .  3 

What's  New  About  Version  4  of  CAST  .  3 

USER'S  GUIDE  .  5 

ADMINISTERING  TESTS  WITH  CAST  .  7 

Overview  .  7 

Getting  Started  .  7 

Tutorial . . .  7 

PRINTING  DETAILED  TECHNICAL  DATA  FROM  CAST  TESTS  .  11 

CHANGING  TECHNICAL  PARAMETERS  IN  THE  CAST  .  13 

Set  Switches .  13 

Set  Item  Information  . .  13 

Set  File  Names .  14 

Set  Scoring  Variables  .  14 

Set  Experimental  Data  .  14 

PROGRAMMER'S  GUIDE  .  15 

SYSTEM  SOFTWARE  .  17 

SUPPORT  FILES  .  19 

Input  Files  .  19 

Output  Files  .  23 


Page 


SYSTEM  OPERATION 
PROGRAM  FUNCTION 


m 

25  Ar 

27 


► 


» 


a 


i 


viii 


» 


•  •  •  •  •  •  •  •  •• 


COHPATIBILITY  EVALUATION  AND  RESEARCH  ON  THE  COMPUTER  ADAPTIVE  SCREENING  TEST 
(CAST)  FINAL  REPORT:  USER  AND  PROGRAMMER'S  GUIDE 


GENERAL  OVERVIEW 


The  Computer  Adaptive  Screening  Test  (CAST)  has  been  an  extremely  useful 
Job  aid  for  Army  recruiters.  It  allows  them  to  determine  quickly  whether  a 
prospect  Is  likely  to  qualify  for  enlistment  and  enlistment  bonuses.  With 
this  knowledge,  recruiters  can  avoid  wasting  considerable  amounts  of  their  own 
time  and  raising  the  prospect's  expectations  unnecessarily.  Instead,  the 
recruiter  can  concentrate  his  or  her  efforts  on  those  prospects  whom  the  Army 
needs  most.  This  type  of  Job  aid  Is  now  more  la^ortant  than  ever  as 
recruiters  are  being  stretched  to  the  limit  to  meet  recruiting  goals  In  an 
Increasingly  difficult  recruiting  environment. 

The  CAST  ran  successfully  on  the  Joint  Optical  Integration  Network 
(JOIN)  system  that  was  Installed  In  recruiting  stations  throughout  the 
country.  The  Army  Research  Institute,  supported  by  a  team  lead  by  the 
American  Institutes  for  Research  completed  a  major  revision  to  the  CAST.  This 
effort  Included 

e  significant  expansion  and  recallbratlon  of  the  Item  bank, 

e  editorial  and  statistical  screening  of  all  Items  for  sensitivity 

and  fairness  and  for  appropriate  statistical  properties, 

e  revision  of  the  Item  selection  software  to  Increase  precision  at 
key  points  and  to  decrease  the  predictability  of  the  sequence  of 
Items  selected,  and 

e  revision  of  the  form  and  substance  of  the  Information  provided  to 
the  recruiter  and  the  prospect  to  Increase  Interpretablllty  and 
usability. 

The  CAST  revision  project  was  highly  successful  In  meeting  each  of  Its 
objectives.  The  project  did  not,  however.  Include  any  technical  assistance  to 
the  programming  staff  of  the  U.S.  Army  Recruiting  Conmand  (USAREC).  More 
Important,  the  JOIN  systems  are  being  replaced  with  a  new  system,  the 
Electronic  Information  Delivery  System  (EIDS),  and  the  CAST  software  must  be 
able  to  run  on  this  new  system. 

This  report  summarizes  the  effort  by  the  Army  Research  Institute, 
supported  by  a  team  from  the  American  Institutes  for  Research  to 

e  provide  program  maintenance  and  ensure  CAST  compatibility  with  the 
EIDS,  and 

e  further  refine  the  Item  selection  software  and  score  reporting 
format. 
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Given  the  above  objectives,  this  report  Is  framed  as  a  guide  to  the  user 
and  to  the  progranaer.  Information  for  the  user  begins  on  page  3  and 
continues  through  the  section  on  "Administering  Tests  with  CAST."  The 
section  on  "Changing  Technical  Parameters  In  the  CAST"  Is  Intended  for 
researchers  and  program  managers.  The  progranmer's  guide  begins  on  page  13 
and  continues  through  the  end  of  the  text.  A  copy  of  the  software  is 
enclosed. 

As  part  of  this  project,  under  separate  cover,  we  also  report  on  an 
evaluation  on  automating  the  collection  of  CAST  scores  from  the  field,  and 
lay  out  the  functional  specifications  of  an  automated  CAST  data  collection 
system.  This  technical  report  is  entitled  "Functional  Requirements  of  an 
Automated  Data  Collection  System  for  the  Computerized  Adaptive  Screening  Test" 
by  R.  Park  and  R.  Rosse. 


INTRODUCTION 

Mhat  CAST  Is 

CAST  Is  the  acronym  for  the  Computerized  Adaptive  Screening  Test  component  of 
the  U.S.  Army  Recruiting  Command's  EIOS  computer  system.  CAST  consists  of 
computer  programs  that  administer  screening  tests  to  enlistment  prospects, 
score  those  tests,  and  estimate  the  prospect's  test  score  and  mental  category 
on  the  Armed  Forces  Qualification  Test  (AFQT)  of  the  ASVAB. 

CAST  consists  of  two  tests  --  Word  Knowledge  and  Arithmetic  Reasoning.  Both 
tests  are  adaptively  administered;  that  Is,  test  Items  are  chosen  one  at  a 
time,  so  that  the  difficulty  of  the  next  test  Item  closely  matches  the 
examinee's  performance  up  to  that  point. 

CAST  has  been  available  for  use  In  Army  Recruiting  Stations  since  1986.  A 
modified  version,  CAST  Version  2  was  used  briefly.  In  late  1987  and  1988,  for 
research.  An  enhanced  CAST  Version  3  has  been  used  since  1989  on  the  JOIN 
computer  system.  This  document  describes  a  revised  version  of  CAST,  CAST 
Version  4,  which  Is  designed  to  run  on  IBM  PC  Clones. 


What's  New  About  Version  4  of  CAST 

CAST  Version  4  contains  a  number  of  modifications  and  enhancements  of  the  CAST 
Version  3.  The  following  Is  a  list  of  noteworthy  changes  contained  In  Version 


New  technical  features  of  CAST  Version  4  Include  the  following: 

a)  Improved  accuracy  for  predicting  mental  categories.  Rounding 
error  was  reduced  so  that  probability  values  for  membership  In 
mental  categories  sum  to  100%. 

b)  Improved  test  Item  selection.  The  first  administered  Item  Is 
selected  from  a  pool  of  candidate  'first  Items'.  This  makes  CAST 
Version  4  less  prone  to  compromise. 

c)  Improved  reporting  capability.  Gives  user  the  choice  of  using  the 
old  report  format  from  Version  3  or  the  USAREC  report  format. 

d)  Improved  Interactive  FARM  setup.  CAST  Version  4  has  a  detailed 
utility  to  determine  number  of  Items  and  where  they  are  to  be 
placed.  It  Is  capable  of  entering  a  debugging  mode  to  display 
updated  ability  estimates  and  standaid  deviations.  Item  bank 
Information,  and  write  out  Item-level  research  data  to  another 
disk. 

e)  Reduction  In  Access  Time.  The  full  Item  bank,  parameters,  and 
Information  tables  are  read  In  as  part  of  the  program.  There  Is 


no  longer  any  need  to  access  the  disk  after  each  question. 


» 


f)  Inproved  experlaental  Iten  selection.  CAST  Version  3  picked 

experimental  items  from  assigned  clusters.  CAST  Version  4  will  * 

randomly  pick  items  from  the  experimental  item  bank. 

g)  Improved  data  storage  capability.  Gives  user  the  choice  of 
defining  where  the  data  will  be  stored. 

h)  Improved  item  bank  access.  A  protected  utility  allows  the  user  to  * 

enter,  edit,  and  remove  test  items.  The  utility  program  allows 

the  translation  of  text  into  binary  data. 

i)  Inproved  software  coordination.  Filename  defaults  were  changed  in 
accordance  with  USAREC  naming  conventions. 

I 
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USER'S  GUX 


CAST  Version  4  Includes  programs  for  two  different  functions.  One  set  of 

programs  administers  the  CAST  tests  and  prints  a  report,  Intended  for  use  by 

the  recruiter,  that  predicts  the  prospect's  AFQT  performance.  Another  program  • 

enables  the  researcher  to  manipulate  the  test  administration  process;  this 

program  Is  Intended  for  the  use  of  CAST  system  managers  and  researchers. 

This  User's  Guide  Is  organized  along  those  same  functional  lines.  Serarate 
sections  deal  with  using  CAST  for  test  administration,  and  with  using  it  to 
produce  detailed  technical  reports.  o 

This  guide  Is  Intended  as  a  supplement  to  the  User  Manual  for  the  Computerized 
Adaptive  Screening  Test,  already  In  use  In  the  U.S.  Army  Recruiting  Command. 
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ADMINISTERING  TESTS  UITH  CAST 


Ovtrv1«M  • 

This  section  of  the  User's  Guide  Is  Intended  for  recruiters  and  others  who 
will  administer  the  CAST  test  on  the  EIDS  system. 


Getting  Started  • 

Administering  the  CAST  requires  certain  computer  equipment  and  software. 

Hardware  Required.  CAST  operates  on  the  EIDS  System.  The  CAST  requires  the 
use  of  the  EIOS  computer,  the  display  monitor,  and  the  printer. 

• 

Software  Required.  CAST  Version  4  consists  of  two  software  disks:  a  program 
disk  and  a  data  disk.  The  program  disk  must  be  placed  In  disk  drive  A:  of  the 
EIDS  computer;  the  data  disk  must  be  In  disk  drive  B:.  CAST  Version  4  will 
not  administer  tests  without  both  of  these  disks. 


Tutorial 

The  CAST  test  Is  Intended  to  be  administered  to  a  prospect  by  the  recruiter, 
In  the  recruiting  office  as  part  of  the  EIOS  System.  This  tutorial  contains 
Instructions  for  the  recruiter  who  will  administer  the  CAST  test. 

The  CAST  User's  task  Is  quite  simple.  There  are  three  major  activities: 
starting  the  CAST  program,  registering  the  examinee,  and  displaying  the 
results.  The  tutorial  describes  each  of  these  activities  briefing.  A  more 
complete  description  Is  contained  In  the  User  Manual  for  the  Computerized 
Adaptive  Screening  Test,  which  was  prepared  for  the  original  version  of  CAST 
by  the  Navy  Personnel  Research  and  Development  Center. 

The  Instructions  that  follow  presume  that  the  CAST  User  Is  familiar  with  the 
operation  of  the  EIDS  computer  system. 


Starting  the  CAST  computer  program 

The  CAST  program  may  be  started  automatically  by  the  EIDS  system,  or  manually 
by  the  User. 

Automatic  Start.  The  CAST  computer  program  starts  automatically  at  the  end  of 
the  EIDS  session,  when  requested  by  the  User.  The  computer  screen  will  prompt 
the  User  to  put  the  CAST  program  disk  In  Drive  A  of  the  computer;  at  this 
point,  the  CAST  Data  Disk  should  be  placed  In  Drive  B. 

Manual  Start.  The  User  may  start  the  CAST  program  manually  In  two  ways.  The 
first  Is  done  with  the  computer  turned  off.  Place  the  CAST  Program  Disk  In 
Drive  A,  close  the  disk  drive  door,  and  turn  the  computer  on.  After  a  few 
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moments,  the  CAST  program  will  start  automatically. 

The  second  method  Is  used  when  the  computer  Is  already  turned  on.  To  start 
CAST  In  this  situation,  place  the  CAST  Program  Disk  In  Drive  A,  close  the 
door,  and  press  the  computer's  reset  button.  The  CAST  program  will  start 
automatically  after  a  few  moments. 

Summary.  There  are  three  ways  to  start  the  CAST  computer  program:  1) 
automatically,  at  the  end  of  the  CIOS  session;  2)  by  placing  the  CAST  Program 
Disk  In  Drive  A,  and  turning  the  computer  on;  3)  by  placing  the  CAST  Program 
Disk  In  Drive  A  and  pressing  the  computer's  RESET  button. 


Administering  a  CAST  test 

Once  the  CAST  computer  program  has  started,  It  has  only  one  function:  to  * 

administer  the  CAST  test.  To  proceed,  the  User  has  only  to  read  the 
Instructions  that  appear  on  the  screen  and  follow  them. 

The  first  screen  displayed  by  CAST  contains  the  CAST  logo;  at  the  bottom  It 
prompts  the  User  to 

» 

PRESS  <ENTER>  WHEN  READY 

Press  the  key  labeled  ENTER  on  the  keyboard  to  proceed. 

The  program  then  checks  for  the  Identifying  Information.  This  Includes  both 

the  data  collection  dUkette  and  the  prospect  Information  diskette.  If  this  » 

Information  Is  not  found,  the  computer  will  prompt  the  user  to  insert  the 

corresponding  diskette  Into  the  proper  disk  drive. 

Once  all  the  Identifying  Information  has  been  completed,  the  CAST  test  will 
begin.  At  this  point,  the  examinee  should  be  seated  at  the  computer  and  ready 
for  testing.  When  the  examinee  Is  ready  to  begin  testing,  he  or  she  should  i 

press  the  key  labeled  ENTER  on  the  keyboard. 

The  examinee  can  be  left  alone  while  CAST  testing  Is  In  progress.  Self- 
explanatory  Instructions  are  displayed  on  the  computer  screen.  Examples  of 
the  screen  text  are  In  the  User's  Manual. 

a 

If  at  any  time  during  testing  the  examinee  enters  the  Incorrect  key.  In 
response  to  a  prompt,  three  times  In  a  row,  the  following  message  will  appear: 

You  seem  to  be  having  trouble 
understanding  the  directions. 

Please  call  the  recruiter  • 

for  assistance.  Thank  youl 

PRESS  <ENTER>  WHEN  READY 

Following  this  screen  the  computer  prMipts  the  recruiter  to  enter  his 

passcode.  • 
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Recruiter, 

Pleese  enter  your  passcode 


i 


e 


At  this  point,  type  the  passcode:  ARMY.  If  the  passcode  is  entered 
correctly,  the  program  will  proceed  with  the  following  screen: 

The  applicant  was  repeatedly 
giving  inappropriate  answer 
alternatives. 

PRESS  <ENTER>  WHEN  READY 

After  the  ENTER  key  is  pressed,  the  recruiter  is  given  the  following  menu  to 
choose  for  the  appropriate  course  of  action: 

Which  of  the  following  courses  of 
action  do  you  wish  to  take? 

A)  START  THE  TEST  AGAIN 
FROM  THE  BEGINNING 

B)  RESTART  THE  CURRENT 
SUBTEST 

C)  CONTINUE  THE  TEST 

D)  '  STOP  THE  TEST 
ENTER  YOUR  SELECTION 

The  User  then  enters  the  letter  corresponding  to  the  desired  action. 

When  the  CAST  is  finished,  a  screen  message  to  the  examinee  will  appear: 

The  CAST  test  has  ended. 

Please  inform  the  recruiter  that 
you  have  completed  the  CAST  test. 

Press  ENTER  key  twice  to  continue. 
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Displaying  the  CAST  test  results 

Once  an  exuinet  has  finished  the  CAST  test,  the  recruiter  can  display  the 
results  on  the  screen,  and/or  print  them  on  the  printer.  This  must  be  done 
iinBediatelv  upon  test  completion. 

The  test  results  are  protected  to  ensure  examinee  privacy  and  system  security. 
To  display  the  results,  the  User  must  first  enter  the  system  password.  A 
screen  message  will  state: 
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RECRUITER. 

PLEASE  ENTER  YOUR  PASSCODE 

At  this  point,  type  the  passcode:  ARMY  and  press  the  ENTER  key.  If  the 
passcode  Is  entered  correctly,  the  prograia  Mill  proceed  to  the  score  report 
function.  If  the  passcode  Is  entered  Incorrectly,  the  system  will  sound  a 
warning  cone;  at  this  point  try  again  to  enter  the  passcode,  ARNY. 

Once  the  passcode  Is  correct,  the  screen  will  display: 

00  YOU  WANT  TO  DISPLAY  THE  CAST 
RESULTS?  (Y/H) 

Press  the  Y  key,  then  the  ENTER  key  to  answer  ”yes*.  The  next  screen  will 
display  the  test  results.  In  narrative  and  graphic  form. 

The  results  give  the  probability  that  the  examinee  will  score  In  each  of  three 
AFQT  mental  categories  when  he/she  takes  the  ASVAB.  The  three  categories  are 
1)  mental  category  1,  2,  or  3a:  2)  category  3b;  and  3)  category  4  or  5. 

To  proceed  past  the  results  screen,  press  the  PAGE  FWD  key.  The  next  screen 
offers  a  printout  of  the  CAST  results: 

DO  YOU  WANT  A  PRINTOUT  OF  THE  CAST 
RESULTS?  (Y/N) 

Press  Y,  then  ENTER,  for  a  printed  copy  of  the  score  report.  The  screen  will 
display  Instruction  for  setting  up  the  printer,  and  Instruct  you  to  press 
ENTER  To  begin  printing.  You  may  cancel  the  print  process  by  pressing  the  Esc 
key  at  this  time. 

The  printout  begins  as  soon  as  the  ENTER  key  has  been  pressed.  When  the 
printing  Is  complete,  the  following  screen  instructions  appear: 

Remove  the  CAST  program  diskette  from 
Drive  A  and  replace  It  with  the  Sales 
Presentation  Disk. 

Remove  the  CAST  data  diskette  from 
Drive  B  and  replace  it  with  the 
Prospect  Data  Disk 

PRESS  THE  ENTER  KEY  WHEN  READY 

At  this  point,  CAST  testing  Is  complete. 
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PRINTIN6  OHAILEO  TECHNICAL  DATA  FROM  CAST  TESTS 

(Versions  3  and  4) 


The  CAST  disks  contain  a  set  of  four  chained  prograns  that  allow  the  User  to 
print  detailed,  1ten-by-1te«  records  of  the  CAST  test  recorded  on  any  CAST 
Data  Disk. 

The  prograa  gives  the  User  the  choice  of  printing  these  reports  for: 

1)  All  exaMlnee  records  on  the  Data  Disk; 

2)  An  Individual  exaalnee; 

3)  The  last  exaslnee  tested. 

The  use  of  this  prograa  Is  self-explanatory  once  the  prograa  1$  running.  To 
run  the  report  progran,  do  the  following: 

a.  Start  the  CAST  progra«  nonaally. 

b.  When  the  CAST  logo  Is  displayed,  press  the  ESC  key.  This  will 
cause  the  CAST  prograa  to  halt,  and  give  the  User  control  of  the 
operating  system.  The  systea  prompt  will  be  displayed. 

c.  Type  RUN  REPORT,  and  press  RETURN. 

After  a  moment,  the  heading  "CAST  REPORT  PROGRAM*  will  appear  on 
the  screen,  followed  by  Instructions.  Press  the  RETURN  key  to 
continue  the  program. 

The  next  screen  gives  directions  to  ensure  the  CAST  disk  Is  In 
Drive  A  and  the  Data  Disk  Is  In  Drive  B.  As  prompted,  press 
RETURN  when  the  proper  disks  are  In  place. 

The  following  screen  gives  the  User  the  three  options  listed 
above: 

OISPLAY/PRINT  RESULTS  FOR: 

1)  ALL  EXAMINEES 

2)  ONE  EXAMINEE 

3)  LAST  EXAMINEE 

Enter  your  choice,  and  then  press  RETURN.  Follow  the  Instructions 
that  appear  on  the  screen.  Be  sure  to  use  the  shift  key  to  answer 
Y  or  N,  since  this  part  of  the  program  does  not  recognize  lower 
^ase  letter  Input. 

When  the  User  has  finished  the  program,  the  operating  system 
prompt  will  appear,  and  the  system  may  be  used  as  desired. 
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CHANGIN6  TECHNICAL  PARAMETERS  IN  THE  CAST 


The  PARAMS  progran  is  Intended  for  use  by  systems  nanagers  and  researchers. 

It  has  five  najor  functions  as  exemplified  by  the  Initial  menu  screen: 

1.  Set  Switches 

2.  Set  Item  Information 

3.  Set  File  Names 

4.  Set  Scoring  Variables 

5.  Set  Experimental  Data 

6.  QUIT 

A  detailed  discussion  of  each  function  follows. 

Set  Switches 

This  option  controls  display  of  the  Item  pool  for  Inspection  purposes  by  the 
researcher.  It  allows  the  following  functions: 

1.  Display  Item  Data  (default-OFF).  When  ON,  display  after  the  real¬ 
time  Item  response:  the  Item  parameters,  examinee  response,  and 
real-time  estimates  of  Bayesian  theta  and  variance. 

2.  Display  All  Items  (default-OFF).  When  ON,  all  Items  In  Item  pool 
are  displayed  one  at  a  time. 

3.  Enable  ESCAPE  (default-OFF).  The  ESCAPE  key  Is  activated  to 
facilitate  easy  termination  of  program. 

4.  Write  Data  to  Disk  (defau1t-0N).  Allows  the  data  to  be 
transferred  to  a  data  disk  for  later  mailing  to  the  researcher. 

5.  QUIT 

Set  Item  Information 

This  option  controls  subtest  lengths.  Additional  Items  from  the  Item  pool  may 
be  adaptively  administered  to  examinees  of  lower  ability  levels.  It  allows 
the  following  functions: 

1.  Total  Number  of  WK  Items  (default-257).  This  Is  the  size  of  the 
WK  Item  pool. 

2.  Total  Number  of  AR  Items  (default-254).  This  Is  the  size  of  the 
AR  Item  pool. 

3.  Number  of  WK  Items  to  Administer  (default-10).  This  Is  the  length 
of  WK  subtest. 

4.  Number  of  AR  Items  to  Administer  (default-5).  This  Is  the  length 
of  AR  subtest) 

5.  Number  of  Extra  Ite<as  If  WK  Score  Is  Low  (default-5).  Additional 
WK  Items  given  to  '!o»  rblllty  examinees. 

6.  Theta  Value  to  Determine  Low  WK  (default-. 68).  The  .68  level 
corresponds  to  AFQT  percentile  or  IIIA  and  below. 

7.  Number  of  Extra  Items  If  AR  Score  Is  Low  (default-5).  Additional 
AR  Items  given  to  low  ability  examinees. 

8.  Theta  Value  to  Determine  Low  AR  (default-. 68).  The  .68  level 
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corresponds  to  AFQT  percentile  of  IIIA  end  below. 

9.  QUIT 

Set  File  Hums 

This  option  controls  the  file  names  for  Input  and  output.  The  default 
nomenclature  Is  consistent  with  USAREC  naming  conventions. 

1.  Item  Level  File  Name  (default-CAST.OAT). 

2.  Temporary  Vork  File  (default-CASnEMP.XXX). 

3.  Input  Work  File  (defauU-WORKOl.OAT). 

4.  Output  Work  File  (defau1t-W0RK02.0AT). 

5.  Report  Program  Name  (w/o  .EXE)  (defauU>REPORT2). 

6.  QUIT 

Set  Scoring  Variables 

This  option  controls  the  coefficents  of  predicting  AFQT  from  the  CAST  subtest 
scores. 

1.  First  WK  Probability  Parameter  (default— 2.57). 

2.  Second  WK  Probability  Parameter  (default- 1.96). 

3.  Third  WK  Probability  Parameter  (default-. 27). 

4.  First  AR  Probability  Parameter  (default— 2.00). 

5.  Second  AR  Probability  Parameter  (default-1.49). 

6.  Third  AR  Probability  Parameter  (default-2.36). 

7.  WK  Regression  Coefficient  (default-14.41). 

8.  AR  Regression  Coefficient  (default-11.18). 

9.  Regression  Coefficient  (default-42.775). 

10.  QUIT 

Set  Experimental  Data 

This  option  controls  placement  of  additional  Items  from  the  experimental  item 
pool.  Experimental  Items  are  a<tai1n1stered  non-adaptively  at  the  specified 
subtest  location. 

1.  Total  Experimental  WK  Items  (default-96).  This  Is  the  size  of  the 
experimental  WK  Item  pool. 

2.  Total  Experimental  AR  Items  (default-96).  This  Is  the  size  of  the 
experimental  AR  Item  pool. 

3.  NuMer  of  WK  Items  to  Atelnister  (default-0). 

4.  Number  of  AR  Items  to  Administer  (default-0). 

5.  Placement  of  Experimental  Items.  This  specifies  the  exact 

positions  of  the  Items  for  administration. 

6.  QUIT 


PROGRAMMER'S  GUIDE 


Version  4  of  the  CAST  Systea  consists  of  two  subsystems:  PARAMS  and  CAST.  The 
PARAMS  subsystea  sets  up  the  parameters  for  the  desired  execution  of  the  CAST 
program.  The  CAST  subsystem  contains  the  software  that  administers  the  CAST 
tests,  scores  them,  records  the  results  on  a  data  disk  (If  sped  fled), and 
prints  the  results  (If  specified). 

The  CAST  subsystem  Is  Intended  for  use  by  Army  recruiters.  The  PARAM  subsystem 
Is  for  use  by  researchers  or  by  the  system  manager,  for  statistical  analysis 
or  software  testing  purposes. 

The  PARAMS  subsystem  Is  a  stand-alone  program  In  which  the  researcher  or 
systems  manager  may  adjust  the  parameters  used  by  the  CAST  subsystem  for  a 
specialized  execution  of  the  program. 

The  general  program  flow  of  the  CAST  subsystem  Is  as  follows: 


After  the  CAST  program  has  administered  the  test  and  computed  the  desired 
results,  control  Is  directed  to  either  REPORT!  or  REP0RT2  to  complete  the 
execution  of  the  CAST  subsystem. 

REPORT!  prints  a  report  of  the  examinee  test  results. 

REPORT2  prints  a  report  of  the  examinee's  predicted  AFQT  score. 

When  the  CAST  subsystem  is  completed,  control  is  to  revert  to  the  Sales 
Presentation  disk. 


SYSTEM  SOFTWARE 


The  CAST  and  PARAMS  subsystems  programs  were  written  In  the  QuIckBasIc 
programming  language.  All  assembly  language  routines  In  CAST  version  3  and 
supporting  tools  have  been  rewritten  In  QuIckBasIc. 

The  following  programming  tools  were  employed  In  the  development  of  the 
current  CAST  system  : 

QuIckBasIc  Ver.  4.0 

Used  to  compile  the  following  QuIckBasIc  source  programs:  CAST. BAS, 

PARAMS. BAS,  REPORTl.BAS,  REP0RT2.BAS.  BUILDINX.BAS,  BUILDBSV.BAS 
TXnOBIN.BAS,  BINTOTXT.BAS 


SUPPORT  FILES 


Input  Flits 

The  CAST  progrMS  end  subprograns  require  certain  Input  data  on  disk  files  in 
order  to  perfona  their  functions.  CAST  Is  primarily  a  system  for  Interactive 
administration  and  processing  of  ability  tests.  As  such.  It  requires 
prerecorded  data  such  as  the  text  of  numerous  test  questions,  statistical  data 
that  describes  the  test  questions,  and  precomputed  tables  that  Identify  test 
questions  for  response-contingent  selection  and  administration. 

These  prerecorded  data  were  supplied  to  programmers  In  the  form  of  ASCII 
source  data  files  by  the  Army  Research  Institute  to  the  prime  contractor,  the 
American  Institutes  for  Research. 


For  use  In  CAST  version  4,  the  programmers  compressed  the  source  data  files. 
These  files  were  converted  Into  the  program  format  using  four  proprietary 
conversion  programs:  TXnOBIN.EXE,  BUILDBSV.EXE,  BINTOTXT.EXE, 
BUILOINX.EXE,  these  programs  were  written  In  QuIckBasIc  for  use  on  IBM 
compatible  micro  computers. 


TXTTOBIN.EXE  converts  a  test  Item  text  file  to  a  binary  format. 


BINTOTXT.EXE 

BUILDBSV.EXE 

BUILOINX.EXE 


converts  a  binary  file  containing  test  Items  Into  a 
text  format  that  can  be  edited  using  an  appropriate 
editor. 

properly  saves  a  binary  data  file  In  such  a  way  that 
It  can  be  bloaded  and  accessed  by  the  CAST  programs. 

generates  an  Index  from  the  test  Item  binary  files, 
the  Indices  serve  as  pointers  to  the  compressed  binary 
test  Items. 
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Tht  following  is  a  description  of  the  binary  support  files: 

ITEM  FILES: 

ARITEMS.BIM  compressed  binary  file  of  arithmetic  reasoning  test 
items  (1  -  254). 

WKITEMS.BIN  compressed  binary  file  of  word  knowledge  test  Items  (1 


****  FORMAT  *♦** 

ASCII  file:  OUR  OUTFITS  HERE  jALiKEk  I 

LOOSE 
STYLISH 
SIMILAR 
WRINKLED 
FLASHY 
3 

I 

MEANING:  Question  line  with  word  enclosed  by  a  j  and  k, 

separator 
answer  II 
answer  #2 
answer  13 
^  answer  14 
answer  IS 
correct  answer  I 

item  number  (columns  I  -  3,  right  Justified) 


INDEX  FILES: 

ARITEMS.INX  compressed  binary  file  of  aritNwtic  reasoning  test 

items  index. 

WKITEMS.INX  compressed  binary  file  of  word  knowledge  test  items 
index. 

****  FORMAT  **** 

ASCII  file:  0 

64 


MEANING: 


pointer  value  to  item  ninber  1 
pointer  value  to  item  number  2 
etc. 


PARAMETER  FILES: 
AR.PRN 


coMpressed  file  of  er1th«et1c  reasoning  Item 
paraneters 

conpressed  file  of  word  knowledge  Item  paraneters 


WK.PRM 

****  FORMAT  •*** 


ASCII  file:  Each  record  of  length  13  contains  3  floating  point 

numbers. 


INFORMATION  TABLE  FILES: 


AR.INF  arithmetic  reasoning  Infomatlon  table 

WK.INF  word  knowledge  Information  table 


Binary  File:  Item  numbers 


Meaning:  Matrix  of  700  binary  Item  numbers  arranged  as  follows: 

(35  columns  x  20  rows),  where  each  column  corresponds 
to  a  discrete  ability  Interval,  and  each  Item  numbers 
are  ordered  by  Information  value  (highest  first) 
within  each  row. 


PROGRAM  PARAMETER  FIL^: 

PARAMS.LST  ASCII  file  containing  the  technical  parameters  used 

for  administering  CAST  In  various  modes.  This  file  can 
be  modified  using  the  PARAMS  subsystem. 


****  FORMAT  **** 


The  annotated  defaulted  file  contents  are  shown  below. 


ASCII  file:  0, 

0, 

0, 

257, 

254, 

10, 

5, 

5, 

0.68, 

5, 

0.68, 

-2.57, 

1.96, 

0.27, 


***  debug  flag 

***  all  Item  debug  flag 

***  enable  escape  flag 

***  maximum  number  of  Word  Knowledge 
Items 

***  maximum  number  of  Arithmetic 
Reasoning  Items 
test  length  of  WK 
***  test  length  of  AR 

***  number  of  extra  WK  Items 

***  theta  for  extra  WK  Items 

***  number  of  extra  AR  Items 

***  theta  for  extra  AR  Items 

***  probability  parameter  1 

***  probability  parameter  2 

***  probability  parameter  3 


•  •  •  _ • 


• 

-2.00,  *** 

probability  parameter  4 

• 

1.49, 

probability  parameter  S 

2.36,  *** 

probability  parameter  6 

m. 

14.41,  * 

regression  coefficient  for  WK 

11.18,  *** 

regression  coefficient  for  AR 

42.775,  *** 

regression  constant 

-1,  *** 

write  to  disk  flag 

♦ 

CASHEHP.XXX,  *** 

temporary  result  file  name 

CAST.DAT,  *** 

output  result  file  name 

REPORT2,  *** 

print  result  file  name 

WORKOl.OAT,  *** 

Input  work  file  name 

• 

WORK02.DAT,  *** 

output  work  file  name 

96,  *** 

number  of  WK  experimental  items 

96,  *** 

number  of  AR  experimental  items 

0,  *** 

flag  to  administer  WK  experimental 
items 

0,  *** 

flag  to  a<tainister  AR  experimental 
items 

• 

0,  *** 

tea^orary  variable  if  administer  WK 
experimental  flag  Is  0  (false) 

0,  *** 

temporary  variable  If  administer  AR 
experimental  flag  is  0  (false) 

• 

INPUT  WORK  FILE: 

WORKOl.OAT 

contains  the  prospect  data  for  the  examinee  (enclosed 

'  In  quotes) 

• 

• 

last  na«e 

columns  4-18 

first  naM 

columns  20  •  30 

The  CAST  prograa  Ignores  other  Information. 
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Output  Flics 

The  CAST  systM  uses  three  output  data  files.  Two  of  these  files  reside  on  the 
data  collection  diskette,  the  other  resides  on  the  prospect  data  diskette 


RESULT  FILE  : 

CAST.DAT  contains  a  cunulatlve  record  of  every  CAST  test 

administered  using  that  data  disk.  This  file  has  a 
capacity  United  only  by  the  unused  space  on  the  data 
disk. 

****  CONTENTS  **** 

For  each  test  Individual,  the  following  block  of  Information  appears: 

--  last  name  first  name  date 

--  WORD  KNOWLEDGE 

[  Item  response  and  latency  data  ] 

--  ARITHHETIC  REASONING 

[Item  response  and  latency  data  ] 

••  FINAL  LATELY  latency  value 

Each  given  test  Item  has  the  following  response  data  per  line  : 

Item  number 
space 

Experimental  Item  flag  (Y  or  N) 
space 

Correct  answer 
space 

Actual  Item  response 
space 

Correct  response  flag  (Y  or  N) 
space 

Ability  score  (Theta) 
space 

Posterior  Variance  (PV) 
space 

Elapsed  time  until  a  response  was  entered 


TEMPORARY  RESULTS  FILE  : 

CASTTENP.XXX  contains  the  results  of  the  most  recent 

examinee,  the  format  Is  Identic \1  to  that  of 
CAST.DAT 


OUTPUT  WORK  FILE  : 
WORKOl.DAT 


this  file  Is  appended  with  the  three  probability 
parameters  calculated  by  the  CAST  system. 
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SYSTEM  OKBATION 

The  foJIowinQ  is  o  diagram  outim^g  the  flow  of  Information  in  both  the  CAST  and 
PARAMS  subsystems 


PABAMS.EXE 


♦ 


_ s 

1 _ 

FVSRAMS^ 

1 

f 

patomus 

InpU ;  desired  parameters  Output ;  pararT«.lst 


CAST.EXE 


» 


Input:  p)arams.iit 
wortc01.dat 
arttems.inx 
wldtems.inx 
aritemB.bin 
wldtems.bin 
ar.prm 
wlcprm 
or.lnf 
wk.^ 


Output:  workOl.dot 
cost.dot 
costtempjoa 
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REP0RT1.B£ 


Input  ;param$.lst  Output  :  printed  results  of  CAST  test 

wortcOl.dot 


Input  :  params.ist 
worM01.dat 


Output  :  printout  of  predicted  AFQT 


PROfiRAN  FUNCTION 


The  following  Is  a  description  of  the  algorlthns  and  Methods  used  In  the 
execution  of  the  CAST  prograMS. 

***  CAST.EXE  *** 

Initialize  variables. 

Check  for  PARAN.LST  file,  Issue  error  If  not  found. 

Load  paraMeter  variables  fro«  PARAN.LST  file. 

t'heck  for  Input  Work  File  define  In  the  PARANS  prograM,  Issue  prompt  If  not 
found. 

Retrieve  examinee  data  from  the  Input  Work  File. 

Set  timer. 

Display  the  first  nine  Introduction  screens. 

Subtest  loop: 

Display  subtest  familiarization. 

Initialize  subtest  variables. 

Load  subtest  item  binary  file. 

Load  Information  pointers  and  parameter  pointers. for  subtest  Items 
Initialize  pointers  to  test  Items. 

Initialize  used  area. 

Initial  subtest  item  characteristics  variables. 

Display  the  test  presentation  screen. 

Item  count  loop: 

1)  If  In  all 'Item-debug  mode  then  show  Item  and  get  response  for 
all  Items  from  one  to  length,  then  exit  loop 

2)  Give  experimental  question  If  specified. 

3)  Get  Information  table  colinn  number. 

4)  Get  Item  number. 


S)  start  tiMr. 

€)  Show  ItM. 

7)  Got  responst. 

8)  Stop  tiMr. 

9)  Got  ItM  pariMtors. 

10)  Updatt  Mth 

11)  Urltc  data  to  output  flit. 

12)  If  In  dtbug  aodt  then  display  stats. 

13)  Updatt  strat  varlabit. 

End  Item  count  loop 

Got  final  theta  for  subttst 
Display  subttst  finishtd  scrttn 
End  subttst  loop 

\ 

Stort  tiapstd  tiM 

Display  "One  WMaent  pitast*  screen. 

Compute  PI,  P2,  and  P3  for  displaying  results  graph 

PI  -  Probability  of  AFQT  category  1  to  3a. 

P2  -  Probability  of  AFQT  category  3b. 

P3  •  Probability  of  AFQT  category  4  or  5. 

If  In  wrlte-tO’Output-dlsk  mode,  write  answer  data  to  temporary  data  file 
CASTTEMP.XXX,  append  results  to  CAST.DAT  ,  and  update  the  work  file, 
W0RK01.DAT  with  the  calculate  probabilities. 

Run  the  report. program  specified  n  the  PARAfK.LST  file. 

***  REP0RT1.EXE  **• 

Initialize  variables,  read  In  parameter  variables  from  the  PARAN.LST 
file. 

Retrieve  examinee  data  frt^  the  Input  Hork  File. 
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Clear  screen  and  display  *The  CAST  test  has  ended." 

ProHpt  for  Recruiter  to  enter  password. 

Verify  password. 

ProHipt  for  display  of  the  CAST  results. 

Display  results  If  requested. 

Prompt  for  print  of  the  CAST  results. 

Print  results  If  requested. 

Prompt  for  "Sales  Presentation  Disk." 

***  REPORT2.EXE  *** 

Initialize  variables,  read  In  parameter  variables  from  the  PARAM.LST 
file. 

Retrieve  examinee  data  from  the  Input  Work  File. 

Clear  screen  and  prompt  to  display  the  predicted  AFQT. 

Display  the  predicted  AFQT  If  requested. 

Prompt  for  print  of  the  predicted  AFQT. 

Print  the  predicted  AFQT  if  requested. 

Prompt  for  "Sales  Presentation  Disk." 


